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ABSTRACT 

The effectiveness of a 1-day performance-focused 
human resource (HR) development workshop that was conducted in 21 
sessions in cities throughout North America in March-Sept ember 1996 
was monitored by an electronic survey sent to all 506 participants 7 
days after the workshop. Of those participants, 221 (43%) completed 
the survey, which sought information regarding the following: 
participant demographics; the workshop's support activities; and 
activities in the workshop ' s four targeted performance areas 
(increase proficiency in using the career development model and 
online HR decision-making tool; increase ability to work effectively 
to support other HR functional specialities; build awareness of 
patterns of thought/behavior/results involved in making/communicating 
HR decisions with coworkers/c 1 ients ; and proactively share 
learning/improvement ideas with others). At least 77% of respondents 
considered the workshop effective in supporting at least moderate 
growth in each of the four targeted performance areas. The eight 
primary workshop activities and four support activities were 
considered at least moderately well accomplished by 80% and 65% of 
respondents, respectively. The technique of using electronic surveys 
tied to performance change in the workshop design was concluded to be 
a cost-effective and time-effective research procedure that both 
documented the workshop's effectiveness and provided ongoing feedback 
for continuous improvement. (MN) 
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This study focused on measuring the effectiveness of an Integrative Learning 
workshop provided to 506 human resource professionals in Andersen 
Consulting 's North American practice area. This paper documents the 
effectiveness of these workshop learning activities and growth in targeted 
performance. Implications are drawn for future performance-focused 
education efforts at Andersen Consulting and for a “3-months after" follow-up 
study. Keywords: Performance-focused Learning , Performance Change , 
Integrative Learning , Reflective Learning , Workplace Learning , Research 
Methods , Research Results 
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Andersen Consulting (AC) has pioneered the development and use of performance- 
focused human resource development programs with its global consulting workforce since 
early 1993 (Nowakowski, 1994; Montgomery, 1996a). In Fiscal Year 1996 (September, 

1995 through August, 1996), Andersen Consulting Education (ACE), Andersen 
Consulting’s internally focused professional development organization, invested more 
than $17,100,000 in development and delivery of performance-focused human resource 
development programs for AC’s global workforce of 41,000 consultants (Montgomery, 

1996b) 1 Measuring the performance return on this investment is recognized as a 
challenge and a growing business imperative. Research data documenting the 
effectiveness of these programs has not kept pace with the demand for and development 
of these programs. In early 1996 AC began collecting feedback survey data from 
participants in these programs using electronic media. This use of technology has made 
gathering research data more cost effective and practical. 

This study focused on the reported growth in targeted performance and on the evaluation 
of the effectiveness of the learning activities of one 8-hour, Andersen Consulting performance- 
focused workshop, the “Applied CDM Learning Day,” offered to 506 human resource (HR) 
professionals in AC’s North American practice area between March and September, 1996. This 
workshop was developed using the Integrative Learning approach to performance-focused design 
(Montgomery, 1996c). Feedback gathered during this study was used in a “reflection-in-action” 
process (Montgomery, 1992) to improve the effectiveness of the workshop approximately mid-way 
through the 21 offerings of the workshop. The results of this study were used to launch a “3- 
months after” follow-up study reported elsewhere (Montgomery, 1996e). 

This study represents innovation in human resource development practice at Andersen 
Consulting in five key areas: 

• Use of timed electronic surveys to collect data regarding targeted performance change after 
the workshop was completed. 

• Use of surveys to collect data regarding targeted performance change designed into the human 
resource development workshop and feedback regarding the extent to which workshop 
activities supported that change. 

• Integration of targeted performance change evaluation as part of the design of the human 
resource development learning experience. 
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1 This only represents a portion of the financial investment made by AC in developing its global 
consultants. AC’s gross income for the Fiscal Year was in excess of $4 billion and 6.5% was 
invested in the continuing development of its workforce (Montgomery, 1996b). 
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• Evaluation of the effectiveness of an Integrative Learning workshop conducted primarily by 
Andersen Consulting human resource professionals at multiple locations throughout the 
Americas. 

• “Reflection-in-action” use of research data to improve/enhance the effectiveness of the 
workshops remaining to be conducted. 



Background 

In 1995, in order to stay ahead of the growing demand for deeply skilled consulting professionals 
to meet the needs of its global clients, Andersen Consulting (AC) introduced a competency-based 
framework for recruiting, staffing, and developing its global workforce of consulting professionals 
(1996b). The Career Development Model (CDM) (Montgomery, 1996d) was first introduced in 
AC’s North American practice area in a series of information-focused sessions provided to human 
resource professionals supporting this workforce. It soon became clear that these professionals 
needed additional support to learn to work with this model in their daily routines. To meet these 
needs, a performance-focused workshop was developed in December, 1995, using a systems 
approach to Integrative Learning design (Montgomery, 1996d). The conceptual design for this 
workshop was tested in February, 1996, and the workshop was piloted in March with very minor 
changes. . The design for this workshop was introduced at the 1996 Conference of the Academy 
of Human Resource Development (Montgomery, 1996d). 

After completion of the workshop, learners were expected to have gown in four areas of 
targeted performance: 

• Become more proficient in using the Career Development Model and on-line tool (C-Map 
Writer) in making HR decisions regarding staffing, recruiting, and training. 

• Increase ability to work effectively in supporting other HR functional specialties. 

• Build awareness of patterns of thought, behavior, and results involved in making and 
communicating HR decisions with coworkers and clients. 

• Identify areas for continuing development and growth as a community of HR professionals. 



Research Questions: 

1 . How much growth do learners experience upon completion of the workshop with regard to the 
targeted performance areas of the workshop? 

2. What activities in the workshop do learners see as contributing to the targeted performance 
change? 

3. How well will participants respond to the innovation of electronic survey feedback collected 
after completion of the human resource development program? 



Methodology: 

The “Applied CDM Learning Day” was conducted in 21 sessions at cities throughout North 
America during the period March through September, 1996. The number of participants in each 
session ranged from 1 1 to 46. Each of the 506 participants 2 was sent an electronic survey seven 
days after the workshop 3 and three months after the workshop. 221 participants (43%) responded 



2 While total of 506 human resource professionals participated in the workshop. 92 participants 
participated in workshops conducted after the cut-off date for the “3-months after” surveys used in . 
this study. 

3 This represented an innovation for Andersen Consulting. Until 1996 programs were most 
frequently evaluated on the last day of the program and focused on participant satisfaction with 
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